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We consider a sequence of random variables (Rn) defined by the recurrence Rn — Qn + MnRn-i, 

n>l, where Ro is arbitrary and {Qn,M„), n > 1, are i.i.d. copies of a two-dimensional random 

vector (Q,M), and {Qn,Mn) is independent of R„-i. It is well known that if Mn|A/| < and 

^-* ' _Eln"'"|(5| < CO, then the sequence (-Rn) converges in distribution to a random variable 7? given 

i-Q ' by _R = X^fcLi Qk YliZi Mj, and usually referred to as perpetuity. In this paper we consider a si- 

jrt I tuation in which the sequence (-Rn) itself does not converge. We assume that -Eln|-M| exists 

but that it is non- negative and we ask if in this situation the sequence (Rn), after suitable 

normalization, converges in distribution to a non-degenerate limit. 

Keywords: convergence in distribution; perpetuity; stochastic difference equation 

in ! 1. Introduction 

. . We consider the following iterative scheme 

O; Rn^Qn + MnRn-l, Tl > 1 , (1.1) 

where Rq is arbitrary and {Qn, M,/), n>l, are i.i.d. copies of a two-dimensional random 
vector {Q,M), and {Qn,Mn) is independent of Rn-i- Writing out the above recurrence 
*V^ , we see that 

. P. , Rn=Qn+ MnQn-1 + M„Af„_ig„_2 + • • • + M„ • • • M2Q1 + il/„ • • • A/ii?o. (1-2) 

Note that although (-Rn) is not a sequence of partial sums, after renumbering {QmMn) 
in the opposite direction, we can write 

n n k—1 

Rn = X{M,R^ + Y.QkX{^^i^ (1.3) 

J=l fe=l J=l 
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where "=" denotes the equality in distribution and we adopt the convention that the 
product or sum over the empty range is 1 or 0, respectively. Much of the impetus for 
studying such equations stems from numerous applications of schemes like (1.1) in math- 
ematics and other disciplines of science. We refrain here from giving a long list of fields 
in which equation (1.1) appeared, referring instead to some of the references we give 
(most notably to [6, 22] for the status up to the early nineties of the past century) for 
more detailed information. Examples of more recent applications closer to statistics are 
given in [2], an application related to neuronal modeling may be found in [13] and, for 
an application in the analysis of algorithms, see [11] and references therein. 

Most of the up-to-date research focused on the situation when the sequence (i?„) 
converges in distribution and on analyzing properties of its limit. It has been known for 
a long time (see [22], Lemma 1.7, or [15]) that if 

E\n\M\ < and E\n+\Q\ < oo, 

then the sequence of partial sums in (1.3) converges almost surely and the product in 
the first term asymptotically vanishes. Thus, (i?„) converges in distribution to a random 
variable R given by 

oo k—1 

fe=i j=i 

This R, referred to as perpetuity, is of central interest. In particular, its tail behavior has 
been thoroughly investigated (see, e.g., [7-9, 14, 15, 22] and references therein for more 
information) . 

In this paper we focus on a situation in which the sequence (Rn) does not converge. 
We will refer in such situations to the whole sequence (Rn) as a divergent perpetuity. 
We will assume throughout that MnjAf ] exists but that 

fi:=E\n\M\>0. (1.4) 

Under the above assumption we ask if (i?„) can be renormed to converge in distribution 
to a non-degenerate limit. As is the case when (i?„) converges, the roles of Rq and Q seem 
to be of much less importance than the role of M. In fact, since Rq plays no significant 
role from now on we assume that Rq =0. Furthermore, assuming that M is non-random 
would lead to (Rn) being a sequence of sums of independent random variables. Since 
this situation has been extensively studied, we will exclude it from our considerations 
by assuming from now on that AI is non-constant. On the other hand, we freely impose 
moment conditions on Q when necessary, or sometimes even assume that it is of a special 
form. For example, if Q = 1, then (1.3) is just a partial sum of successive partial products 
of i.i.d. copies of M. While there is very little known technical connection, it is perhaps 
worth mentioning that an analogous problem of investigating the asymptotic properties 
of the consecutive products of partial sums 

n k n k 

riE^^^ vs. Eii^^' 
k=ij=i k=ij=i 
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has been intensely investigated in the past several years; see, for example, [19, 21, 23]. 

As X — >■ hix is concave, assumption (1.4) implies that necessarily E\M\ > 1. (We do not 
assume, however, that E\M\ is finite.) Thus there are at least four situations to consider, 
namely, 

(i) ^ln|Af| >0, E\M\ > 1, |A/| non-random, 

(ii) Eln\M\ > 0, E\M\ > 1, |A/| random, 

(iii) Eln\M\ = and E\M\ > 1, 

(iv) Eln\M\ = and E\M\ = 1. 

These cases are discussed in detail below and wc will show that in each of these situations 
(i?„) can be renormed (each time differently) so that it converges in distribution to a non- 
degenerate limit. As was brought to our attention by A. Iksanov, some particular cases of 
(ii) and (iii) were studied by Rachcv and Samorodnitsky [20] who, for non-negative Q and 
Af and under the assumption that log Mn belongs to the a-stable domain of attraction, 
obtained the log-stable limit law for suitably normalized (i?„) ~ see also comments on 
this connection in Sections 3 and 4. Furthermore, weak convergence in the situation 
complementary to (1.4) is considered in [17] where, for non-negative Q and M, it is 
assumed that — oo < In Af < 0, but the perpetuity is divergent because Eln Q = oo. 

2. The case £^ln|M| > 0, E'lM] > 1 and non-random 

\M\ 

In this section we consider the following situation: for a fixed p > 1 let 
M = pe, where P{e — 1) =p, P{e — —I) — I — p — q. 

Theorem 1. Let M be as above. Assume that Q = e and that it is independent of M . 
(i) Symmetric case: Let p = 1/2. Then 

R 






fe=l 



where X — p ^ < 1 and (sk) is the sequence of i.i.d. copies of e. 
(ii) Asymmetric case: Suppose py^ 1/2. Then we have 



^^rX, (2.1) 

in— 1 ' ^ ' 



p 

where r is a symmetric Bernoulli random variable (i.e., P{r = 1) = P{r = —1) = 1/2J, 
^ = SfeLo -^^ rii^i ^3 '^'^'^ ^ ^''^'^ -^ '^'"^ independent. 
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Remark. The sums of the form X^feLi ^'^^^^k considered in part (i) are well-known ob- 
jects, usually referred to as "symmetric Bernoulli convolutions". Their properties have 
been extensively studied since mid-1930s. In particular, it is known that the limiting 
distribution is uniform on [—2,2] if X = 1/2, singular if < X < 1/2 and absolutely con- 
tinuous for almost all (but not all) A € (1/2, 1). A good description of the current state 
of knowledge can be found, for example, in [18]. 

Proof of Theorem 1. Wc have 

n n k 

Rn = £„ + penSn-i + ' ' ' + p""' H^J^Y. P^^^ IT ^r (2.2) 

J = l k=\ ] = 1 

If p = 1/2 then the sequences 

(£l,£ie2,£l£2£3,---) and (£i,£2,£3, • ■ ■) (2.3) 

are identicaUy distributed. Thus, if we normahze _R„ by p"~^, we get 

— Y = ^p £fe=^A £fe. 

^ fe=l fe=l 

Since < A < 1 the series of partial sums converges almost surely and thus Rn/p"^^ 
converges in distribution to the given limit. 

If p 7^ 1/2, then the distributional equality in (2.3) is no longer valid. However, we can 
write the right-hand side of (2.2) as 

n k n / n \k—\ \ 

k=\ j=l j=l \k=l i.i.j=l^J / 

Since Sk = l/£fc we get 



^=^-11^. (2-4) 



where 



fe=i j=i 



fc-i 



Fix arbitrary m. Then, for any n> m, write the term on the right-hand side of (2.4) as 



j=l J = l \fc=Tn+l j=l 



k-1 
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The second summand is bounded in absolute value by A"* /(I — A) and thus it can be made 
arbitrarily small by choosing m sufficiently large. Consequently, we consider only the first 
part of the above expression. Note that Tm depends on (ei, . . . , £„) only. Therefore upon 
conditioning on (si, . . . ,£„) wc obtain 



E{e''^"^^7=i'^)^E 






where (jjk is the characteristic function of the product 07=1 ^j- Since ni=i ^j = 1 if and 
only if the number of j 's such that Sj = —I is even, we have 

k-cvcn k-odd 

(2.5) 
= {p-q)\ 

which vanishes as n — >■ oo. Thus the product Jlfci ^j converges in distribution to r (recall 
that its characteristic function is cos(t)). Therefore for arbitrary fixed m 

E{e''^"^^'^-^'^)''^^ Ecoslmnf[eA :=^ E cos{tT^) . 

As 771 — )> cxj the sum T,„ converges almost surely to X. By the Lcbesgue dominated 
convergence it follows therefore that 

Ecos{tT,n) "^ Ecos{tX), 

the latter being the characteristic function of rX, with r and X independent. This 
proves (2.1). D 

3. The case ^ln|M| > 0, E\M\ > 1 and random \M\ 

In this section we assume that /i = _Eln|Af | > and that \M\ is random. This forces 
E'jAf I > 1, but it may be infinite. Set u^ :— var(ln|il/|). Then we have 

Theorem 2. Let (Rn) be given by (1.3) with the pair (Q,M) satisfying fj, > 0, 
< v^ < oo, and E\n'^\Q\ < cx). 

(i) As n — >■ cxD, 

exp(^v^/w) 
where N is a standard normal random variable. 
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(ii) Assume P{M > 0) > and P{M < 0) > and define for real t and x, x* := 
sgn(a;)|x|*. Then we have 

pi/(«V") 
^ re , 



e-xp^^iy/n/v) 
where r is a symmetric Bernoulli random, variable independent ofAf. 

Remark. The first part of this theorem overlaps with Theorem 2. 1 (a) in [20] where, for 
non-negative Q and M and under the assumption that In M is in the domain of attraction 
of an a- stable law, 1 < a < 2, the authors obtained (i) with M replaced by an a-stable 
random variable and suitable normalization of (Rn) on the left-hand side (the normalizing 
constants are the constants implied by the definition of a domain of attraction). 

Proof of Theorem 2. Consider i?„ given in (1.2) and factor the product of A/j's to 
write it as 



^"= n^i E^^ii]^- (3-1) 

\j = l / fe=l 3 = 1 ^ 

Consider the first factor. By the classical CLT 

exp{{fj,/v)y/n) \ e'^" / \ vy^ J 

To finish the proof by Shitsky's theorem it suffices to show the second factor on the 
right-hand side of (3.1) converges to 1 in distribution. To this end note that 

n k ^ ^ r\ k—l _. 

Sn.=yQk\\—=y—\\— (3.2) 

fc=l i=l ^ k=l " j=l ^ 

is a perpetuity generated by {Q/M,l/M). Since we are working under the condition 
i?ln|M| > 0, we have £'ln|l/A/| = — _Eln|Af| < 0. Furthermore, by our assumption on 
Q, E\n^\Q/AI\ < cx) and thus (Sn) converges in distribution to, say S (see [22], Theo- 
rem 1.6(b)). Moreover, P(l/Af = 0) = and hence by Theorem 1.3 of [1] (see also [10] 
and [3], Lemma 2.1) it follows that the distribution of S is continuous. In particular, 
jS'p" does not have an atom at zero, which is all that is important for our purposes. 
Denote by Vn and v the distributions of IS",!]^/" and jS*!^/", respectively. We want to show 

that jS'nl^/'^^^^ — > I. Consider first an arbitrary x e (0, 1), fix an arbitrary m and take 
any n> m. Then 

P(|5„r/("v^) < x) = i.„([0, x-V^]) < z.„([0, zv^]) "-=^ K[0, xv^]). 

Letting now m -J> oo we conclude that P{\Sn\^^^'"^^ < a;) -> for x £ (0, 1). 
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Now we take an arbitrary a: > 1. Then again we fix some m. For n> m we obtain 

p(|^^|i/(.VH) < ^) ^ z.„([0,x^]) > M[0,^^]) "=^ ^([0,x^]) "^^ 1 

so that P(|S'„p/(^\^) < x) ^ 1 for a; > 1 and it fohows that |^„|l/("^^) 4 1, which 
completes the proof of part (i). 

To prove part (ii) let Ej — sgn{Mj) and consider again 

where {Sn) is defined by (3.2). By definition of x*, 

Zn := ^^^ -sgn(5„)|5„|V(^y^) (fl,\ expfx: '-^^^^] . (3.3) 

exp(^V^/w) \^^A^-^ y \^^ y^ J 

For any m < n write the sum in the exponent of (3.3) as 

~".\n\Mj\-^ >A ln|A/j|-^ [ [7^ \^ln|Mj|-^ 






V\/m ^ — ' V\/n \ \ n / ^ — ' vwm 

Splitting the product of signs on the right-hand side of (3.3) in two factors, and using 
the above equation, we see that (3.3) can be written as 

Zn={ n ej)^™K,m, (3.4) 

\j=m+l ) 



sgn(5„) I^Ji/f'^^) / ^ ln|Mj|-/i , / [^ \^\^\M.^\-yi 



where 

*'"■'" -sgn(5™)|5„|V(^V^)'"Pl^^.i;^^^ «V^ +l^Vn Vfe 

We claim that (V^i,m) converges in probability to 1 as long as n, ttj — > oo in such a way 
that n — TO = o(n). To this end, consider the first sum in the exponent above. Its variance 
is {n — vi)/n, and thus as long as n—m = o{n) it goes to in probability by Chebyshev's 

inequality. Furthermore, under the same condition on n — tti, -v/^— 1 = a/1 — -^ — 1 = 
o(l) and thus the second term in the exponent above goes to in probability as well. 
(Note that the sum of "' ilr^ converges in distribution to N by the classical CLT.) 

As for the other factors in Vn.rm just as in part (i), \Sk\^/'^'"^^'^ — > 1 as fc— )-oo, 
where " — )■" denotes the convergence in probability. It remains to show that sgn(S'„)/ 
sgn(5'„i) — > 1. To this end, note that the equation (3.2) defining {Sn) holds a.s. and not 
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only in distribution and thus the sequence (Sn) is a sequence of partial sums. Hence, by 
the basic convergence result for perpetuities (see, e.g., [22], Lemma 1.7), the conditions 
iJlnll/A/l < and Elii^lQ/M] < oo suffice for the a.s. convergence of the series 

oo ^-. fc— 1 _. 

E Wk TT _1_ 

fe=i ]=i -^ 

This, together with the fact that the limit of (Sm) has a continuous distribution function 
(sec an argument following (3.2)), clearly implies that sgn(S'„)/sgn(5'm) — > 1 (and a.s.) 
as m,n^t oo. This proves our claim about (Ki.m). 

We now go back to (3.4) and note that the first two random variables on the right-hand 
side are independent. Furthermore, the product ni^m+i^j converges in distribution to 
a symmetric Bernoulli random variable r (see (2.5) above) as long as n — m^oo. Hence, 
if the sequence (3.3) converges in distribution, then its limit, say Z, has to satisfy the 

distributional identity Z = rZ , with r, Z independent on the right-hand side. This would 
complete the proof since any such Z is symmetric and we would have 

Z^r\Z\^rc^, (3.5) 

where the second equality follows by part (i). 

Thus, it remains only to prove that the sequence given in (3.3) does, in fact, converge 
in distribution. We note that this sequence is tight because the sequence of absolute 
values 

I I n"=ii^^ji . |i/(„v^) 

converges in distribution to e-'^^ by part (i) . We will complete the proof by showing that 
every converging subsequence of (3.3) converges to the same limit, namely re . Let (fc„) 
be any subsequence for which {Z^^) converges in distribution. Define 

in = max{TO : fc,„ < v A:„} and set 77i„ = fc„ — ki^ . 

By tightness we can choose a subsequence (m„.) of (m„) for which {Zm„.) converges in 
distribution. Since 77i„ . =kn — kp we have 




It is readily seen from the construction that fc„, — ?7i„. =o(fc„.) and that it converges 

p . — 

to infinity. Therefore, Vfc,^..,„„. — > 1 as j — > oo. Thus, if Z and Z are the limits in 

distribution of (Zfc„) and (Z„j^ ), respectively, then the above identity implies that Z = 
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rZ , where r and Z are independent. It follows that Z is symmetric and thus must satisfy 
(3.5). Since Z was a limit along the arbitrary converging subsequence of {Zn), the proof 
is complete. D 



4. The case £;in|M| = and E\M\ > 1 

To see the difference between the current situation and the preceding one, note that 
because i?ln|A/| = the perpetuity defined by (3.2) in the course of the proof of Theo- 
rem 2 is not guaranteed to converge. Specifically, consider the following example: let X 
be a non-degenerate, integrable, symmetric random variable and set M = c^ . Then, 

E\ii\M\=EX = and £:|M| > c^"^ = 1, 

where the strict inequality follows from the non-degeneracy of X. By the symmetry of X, 
M and \/M have exactly the same distribution. Hence, if we take Q = 1 in (1.3) and 

(3.2) we find that i?„ = Sn for n > 1. Therefore, (i?„) and [Sn] converge or diverge 
in distribution simultaneously. If M is non-negative this difficulty can be handled by 
factoring the largest product in (1.3) rather than the last one; however, the limiting 
distribution will no longer be lognormal. It seems very likely that the case of general M 
is similar, however it remains open. 

Before stating our result in the non-negative case, recall that a function /i : R — >■ R is 
regularly varying at infinity with index p if for every a; > 

lim^=.^ 
t-»-oo h{t) 

Recall also that any such function can be written as h{t) = tP£{t), where i{t) is slowly 
varying at infinity; that is, for every a; > 

hm^^l. 

t^oo e{t) 

It follows from that definition in particular that for any S > 0, t^£{t) — > oo as i — > oo 
(see [5] for these and much more on regularly varying functions). The following holds 
true: 

Theorem 3. Let {Q,M) be given by {c^ ,0-^), where EX = and v'^ := var(X) satisfies 
< w^ < oo (so that ElnM = 0; EM > 1, but may be infinite; and v^ = var(ln Af) < ooj. 

(i) // EY^ < oo, then, as n — > oo, 

^i/(-ys)^el-^l, (4.1) 
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where \Af\ , the absolute value of the standard normal random variable, has distri- 
bution given by 

PiW\ < x) ^ 2$(x) - 1 = y - / c~*'/' dt. 

(ii) Let h{t) := P(Y >t) be a tail function of a random variable Y and define a sequen- 
ce (jn) by 

7„ :=infi t:/i(t) < - L n>l. 

If h(t) is regularly varying at infinity with index a for some —2 < a < then, as 
n — >■ oo 

i?i/7„^e^°, (4.2) 

where Va has Frechet distribution $„ given by 

(iii) Assume that h{t) is regularly varying at infinity with index a = —2, that is, that 
h{t) ^t^'^Hit), where £{t) is slowly varying at infinity. If limt-foo £{t) = oo, then 
(4-2) holds, while iflmit^oai(t)=0, then (4--1) holds. 

Remarks. (1) The only case not covered by the above theorem is a ~ —2 and £{t) ^ 
const. We suspect that in that case, at least when X and Y are independent, we have 

niaxi<fc<„{Yfc + 5'fc-i} d .. , .. 

1= > Va+a-AI , 

y/n 

where Va is a Frechet random variable with parameter a — —2, a is the variance of X 
and Va and J\f are independent, but we have not managed to prove it. 

(2) Part (i) of Theorem 3 overlaps with Theorem 2. 1 (c) of [20], where the authors 
worked under the assumption that X is in the domain of attraction of an a -stable law, 
1 < a < 2, but assumed additionally that X and Y are independent. Under a suitable 
normalization that agrees with ours for a ~ 2 and results in a slightly weaker condition 
on Y than EY''^ < c», they obtained as a limit law the distribution of a supremum of the 
Levy a-stable motion on [0, 1]. A similar comment applies to the second part of (iii); we 
assume the regular variation of the tail of Y but not independence of X and Y as was 
assumed in [20], Theorem 2.1(c). When a = 2, the assumptions about the decay of the 
tail of Y in both papers are identical. 

Proof of Theorem 3. Set 

fe-i 



Wn := max Qk TT Mj 



l<k<r 
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and write 

^y(^v/^) = ^y(.v^)K^^l^l|zii!!i . (4.3) 

Since x -^ In .t is increasing, 

We let Yfc = ln(5fc, X^ =lnMfe, S'^ = J2i=i-^k and, for any sequence of random variables 
(Zfc), we will write Z*^ = niaxi<fc<m Zk- 

Subadditivity of the maxima implies that for any numerical sequences (ufc), (wk), 

max{wfc|— max||wfe|}< max jw/j + Wfej < max{ufc|+ max jw/cj. (4.4) 

l<fc<n l<fe<n l<k<n l<k<n l<k<n 

To prove part (i) we note that 
Indeed, for e > we have 

where the last assertion follows from EY^ < oo. Using this and (4.4) with u^ ~ Sk-i and 
Wk = Yk we obtain that 

maxi<fc<„{Yfc + S'fc-i} 5*_i 

^^ — 7= = — ^+op 1), 

where op(l) denotes a quantity that goes to zero in probability. Furthermore, our as- 
sumptions on Mj's imply that (X]?^! -^j) i^ a sequence of partial sums of random walk 
whose increments Xj have mean zero and a finite variance w^. Thus, the Erdos-Kac 
theorem for the maxima of random walks (see, e.g., [12], Theorem 12.2) implies that 

Just as in the proof of Theorem 2, to complete the proof we need to show that the second 
factor in (4.3) converges to 1 in distribution. But that is clear since, on the one hand. 
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and, on the other hand, we clearly have 

2-^ T/f/._ - ■ 



w, 

fc=i 



This implies that 




> — > 1, 

k=l 

and proves part (i). 

The argument for the second part is parallel to the one just given with the following 
adjustment: In the first part, the assumption EY^ < oo ensures that the maximum of 
the random walk with increments Xj, j <n, dominates the maximum of {Yfc, k <n}. 
If this assumption is weakened this may no longer be true, and, in fact, the maximum 
of Yfc's may dominate. In that case, we can just use the basics of extreme value theory 
(Chapter 1 of [16] being more than enough) instead of the Erdos-Kac theorem to complete 
the argument. This time, using (4.4) we write 



f; - i5„-i r < max n. + > , X, } < y: + s: 

l<k<n 

By the characterization theorem in the extreme value theory (see, e.g., [16], Theo- 
rem 1.6.2), our assumption on 1" is a necessary and sufficient condition for the existence 
of constants (a„), (bn) for which 

a„(y„* -bn) — >Va, 

where Va has the Frechet distribution (also referred to as a type-II extreme value distri- 
bution) described above. Furthermore (see [16], Corollary 1.6.3), we may take a„ = l/7n 
and 6„ = 0, n > 1, and, if we do, we obtain that 

> Va, n—>-oo. 

7n 

We now observe that 7„/-y/n^' oo. In fact, there exists /3 > 1/2 such that 7„ > n^ for all 
sufficiently large n. Indeed, since h is decreasing it is enough to see that h{n^) > 1/n. 
But as h is regularly varying, we have 

n n n 

If we now take 1/2 < j3 < —1/a (which is possible since —2 < a < 0) then 5 > Q and 
the numerator on the right-hand side goes to infinity with n, proving the claim that 
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h[n^) > 1/n for large n. We now get 



\Sn-l\* \Sn-l\* V^ P n 



In V"' 7n 



and also, since jn/Vn^>- cx3, 



which proves the second part. 

Finally, the last part follows by essentially the same reasoning. Assume £{t) ^ oo as 
i — > oo. By the just-given argument, to establish (4.2), it suffices to verify "fn/\/n ^ oo as 
n — > oo. Assume this is not the case. Then there exist C < oo and an infinite subsequence 
(uk) such that 'jnk/^/nk < C for all fc > 1. By the definition of (7„) this means that 
P{Y > C^frvk) < 1/n-fe, that is, that i(C~^/nh) < C^. But that contradicts the assumption 
that £(t) — >■ oo as f — > oo . If , on the other hand, i(t) — )■ as i — !• oo , then 7„/-v/n -> (for 
otherwise there would exist c > and a subsequence (n^) such that 7„^ /^/^ > c, fc > 1, 
implying that £{cy/rik) > c^ and contradicting i{t) — j- as i — >■ oo). Now, it follows from 
the proof of the first part that ^nj^Jn — >■ is enough to conclude (4.1). The proof of part 
(ni) is completed. D 

5. The case ^ln|M| = and E\M\ = 1 

Under this assumption we have that \AI\ = 1, that is, M takes on values ±1. Consequently, 
because of a non-degeneracy assumption on Af, its expected value must satisfy — 1 < 
EM <1. We have 

Theorem 4. Suppose that EQ^ < oo. Then, as n — !• oo, 

^^/3AA, (5.1) 

where 0^ = EQ^ + 2 ^_j^^^ E{QM) and M is the standard normal random variable. 

Remark. Since — 1 < EM < 1, by straightforward calculation we see that ERn = 0(1) 
and vai (Rn) = l3^n + 0(1). Thus, (5.1) is equivalent to 

Rn — ERn ji , 

^var(i?„) 
Proof. Let a := EM and q := EQ so that 

P^ = EQ^ + 2-^—EQM = vai-Iq + —^M 
1 — a \ 1 — a 
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To prove (5.1) wc write 

n fc— 1 n k—1 n k—1 

Rn =^^^11 ^^1 = E (Qfe - '?) n ^'^1 + « E n ^^0 ■ (5-2) 
k=i j=i fc=i j=i fc=ij=i 

Furthermore, as 

n k—1 n n k—1 n n k—1 

Y.{Mk-a) n M, = -a + l[M, + {l-a)Y,l[ AIj = -l + H ^^.■ + (1-")E IT ^^^' 

fc=l 3 = 1 j=l k=2j=l j=l k=lj=l 

the second term on the right-hand side of (5.2) is 

n k—1 n 



Qk-q + Y^(^^'» " "V n ^'^^' ^' = ^ 



^ „. 1 — a 

Set 

fc-i 

. , n. 

Then, by independence of [Qj^Mj), j > 1, (dk) is a martingale difference sequence with 
respect to (J>i) where T^ = o'(A/i, Qi, . . . , Mk, Qk), k >1. Let Ek denote the conditional 
expectation given Tk ■ Since A/^ = 1 wc have 

2 
j2 ' 



so that, trivially. 



Ek-idi^E[Q-q+^^iM~a)] =P' 



ELl-^fc-l4 P^ n2 

n 
Moreover, since the M^'s are uniformly bounded, for a given e > and n sufficiently 
large 

-^fc-l4-f{|dfc|>eys:} <'iEQ /{|Q|>eys/2}- 

Since EQ^ < oo . the last quantity converges to zero as ?i — >■ oo by the dominated conver- 
gence theorem. This verifies the conditional version of Lindcbcrg's condition: 

n 
It follows by the martingale version of the CLT (see, e.g., [4], Theorem 35.12) that 
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Now, by the above manipulations we have 

Rn _ Efc=i dk q q 



n^. 



^/n v^ {l~a)y/n (1 - a)^ .^^ 

Since each of the last two terms goes to (deterministically and in probability, respec- 
tively). Theorem 4 follows. D 
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